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FIG. 2A 



TouchObjectFlagdbit): WHETHER TOUCH DATA ARE DESCRIBED 
Length(64bits): PACKET SIZE OF TOUCH DATA 
X_MoveFlag(1bit): WHETHER RIGHT/LEF MOVEMENT IS DESCRIBED 
Y_MoveFlag(1blt): WHETHER UP/DOWN MOVEMENT IS DESCRIBED 
Z_MoveFlag(1blt): WHETHER BACK/FORTH MOVEMENT IS DESCRIBED 
MoveDlstance(5): DISTANCE OF MOVEMENT 
MoveSpeecl(5): SPEED OF MOVEMENT 
MoveAcceleration(5): ACCELERATION OF MOVEMENT 
RotationFlag(lbit): WHETHER RIGHT/LEFT ROTATION IS DESCRIBED 
RotationAngle(5): ANGLE OF ROTATION 
RotationSpeed(5): SPEED OF ROTATION 
RotationAcceleration: ACCELERATION OF ROTATION 



FIG. 2B 
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FIG. 3A 



SmellObjectFlagdbit): WHETHER ODOR DATA ARE DESCRIBED 
Length(32bits): PACKET SIZE OF ODOR DATA 
Type{4bits):KIND0F ODOR 
Level(5bits): INTENSITY OF ODOR 
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FIG. 4A 



TasteObjectFlagd bit): WHETHER TASTE DATA ARE DESCRIBED 
Length(32bits): PACKET SIZE OF TASTE DATA 
Typed Obits): KIND OF TASTE 
Level(5bits): INTENSITY OF TASTE 



FIG. 4B 
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FIG. 5 



r START J) 



500 



RECEIVE MULTIMEDIA DATA 



501 



GENERATE COMPRESSED 
STREAM-TYPE VIDEO/AUDIO DATA 



502 



DESCRIBE VIBRATION/ODOR/TASTE EXPRESSED IN MULTIMEDIA 
DATA BY USING TOUCH/ODOR/TASTE DATA DESCRIPTORS 



503 



FORM STREAM-TYPE VIDEO/AUDIO 
DATA INTO VIDEO/AUDIO PACKET 



504 



FORM TOUCH/ODOR/TASTE DATA 
INTO TOUCH/ODOR/TASTE PACKETS 



505 



MULTIPLEX VIDEO/AUDIO PACKETS & 
TOUCH/ODOR/TASTE PACKETS ON FRAME BASIS 



506 



TRANSMIT MULTIPLEXED PACKETS TO RECEIVING PART 



I 



507 



DEMULTIPLEX PACKETS INTO VIDEO/AUDIO DATA & 
TOUCH/ODOR/TASTE DATA IN RECEIVING PART 



T 



508 



DECODE DEMULTIPLEXED 
VIDEO/AUDIO DATA 

] — CZ 



I 



509 



TRANSMIT 
DECODED 
VIDEO DATA TO 
VIDEO D EVICE 

HI 



510 



514 



OUTPUT 
VIDEO DATA 
ON SCREEN IN 
VIDEO DEVICE 



TRANSMIT 
DECODED 
AUDIO DATA TO 
AUDIO D EVICE 

ZII 



r 



511 



JL 



515 



OUTPUT 
AUDIO DATA 

THROUGH 
SPEAKER IN 
AUDIO DEVICE 



TRANSMIT 
DEMULTIPLEXED 
TOUCH DATA TO 
VI BRATION DEVICE 

Z3 



JL 



512 



TRANSMIT 
DEMULTIPLEXED 
ODOR DATA TO 
ODOR DEVICE 



JL 



516 



GIVE USER 
VIBRATION BASED 
ON TOUCH DATA 
IN VIBRATION 
DEVICE 



513 



TRANSMIT 
DEMULTIPLEXED 
TASTE DATA TO 
TASTE DEVICE 



JL 



517 



SPRAY CHEMICAL 

AROMATIC TO 
USER BASED ON 
ODOR DATA IN 
ODOR DEVICE 



i ^518 



RELEASE 
CHEMICAL 
TASTE FORMING 
MATERIALS TO 
USER BASED ON 
TASTE DATA IN 
TASTE DEVICE 



